Statistical Estimation of the Shannon Entropy
نویسندگان
چکیده
منابع مشابه
On the Estimation of Shannon Entropy
Shannon entropy is increasingly used in many applications. In this article, an estimator of the entropy of a continuous random variable is proposed. Consistency and scale invariance of variance and mean squared error of the proposed estimator is proved and then comparisons are made with Vasicek's (1976), van Es (1992), Ebrahimi et al. (1994) and Correa (1995) entropy estimators. A simulation st...
متن کاملModeling the Potential of Gully Erosion Occurrence Applying Shannon Entropy and Statistical Index Models in Seymareh Region
1- Introduction The gully erosion occurrence, due to the high rate of sediment production in the watershed, is one of the problems of natural resources management in the context of soil management and protection. It is known as an important signature of land degradation and forming as well as a source of sediment in a range of environments. Gully erosion often has severe environmental and econ...
متن کاملLocal Shannon entropy measure with statistical tests for image randomness
Article history: Received 24 March 2011 Received in revised form 25 July 2012 Accepted 30 July 2012 Available online 7 August 2012
متن کاملShannon Entropy Estimation in $\infty$-Alphabets from Convergence Results
The problem of Shannon entropy estimation in countable infinite alphabets is revisited from the adoption of convergence results of the entropy functional. Sufficient conditions for the convergence of the entropy are used, including scenarios with both finitely and infinitely supported distributions. From this angle, four plug-in histogram-based estimators are studied showing strong consistency ...
متن کاملRényi Extrapolation of Shannon Entropy
Relations between Shannon entropy and Rényi entropies of integer order are discussed. For any N–point discrete probability distribution for which the Rényi entropies of order two and three are known, we provide an lower and an upper bound for the Shannon entropy. The average of both bounds provide an explicit extrapolation for this quantity. These results imply relations between the von Neumann...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Acta Mathematica Sinica, English Series
سال: 2018
ISSN: 1439-8516,1439-7617
DOI: 10.1007/s10114-018-7440-z